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In this work we address the nature of broken ergodicity in the low temperature phase of Ising spin 
glasses by examining spectral properties of spin correlation functions dj = (SiSj). We argue that 
more than one extensive (i.e., O(N)) eigenvalue in this matrix signals replica symmetry breaking. 
Monte-Carlo simulations of the infinite-range Ising spin-glass model, above and below the Almeida- 
Thouless line, support this conclusion. Exchange Monte-Carlo simulations for the short-range model 
in four dimensions find a single extensive eigenvalue and a large subdominant eigenvalue consistent 
with droplet model expectations. 
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Following Parisi's |lj demonstration of replica sym- 
metry breaking in the low-temperature phase of the 
Sherrington-Kirkpatrick (SK) model ||, there has been 
an ongoing debate concerning the nature of the low tem- 
perature phase of Ising spin glasses in finite dimensions, 
and of glassy states in quenched-disorder systems more 
generally. The Parisi solution breaks ergodicity through 
the segregation of phase space into many ergodic regions, 
separated by energy barriers which are infinite in the 
limit N oo (where N is the number of spins). Each of 
these regions, in the case of a Hamiltonian invariant un- 
der global spin inversion, has an associated region related 
to it by global spin inversion, the pair forming together 
what we will refer to as a pure state pair (PSP) fl. In the 
low-temperature phase of the SK model, there are many 
PSP's, unrelated by any symmetry of the Hamiltonian. 
In accord with common usage we will call this form of 
ergodicity breaking 'replica symmetry breaking' or RSB 
Pj . While the Parisi solution shows every sign of being 
correct for the infinite-range (hence infinite-dimension) 
SK problem, there is still no consensus on the form of er- 
godicity breaking in models with finite range interactions. 
An alternative to the RSB scenario is the 'droplet' pic- 
ture ||, which postulates a single PSP in the low temper- 
ature phase, whose excitations include rare large droplets 
of overturned spins with energy (at size L) scaling as L . 

The principal numerical tool for detecting replica sym- 
metry breaking has been finite size scaling of the proba- 
bility distribution function P(q) for the overlap q between 
the local magnetizations in different pure states. Several 
numerical studies have suggested a behavior in finite di- 
mensions similar to the one at the mean field level HQ . 
Other studies using the Migdal-Kadanoff approximation 
|| and still others at zero temperature M have suggested 
otherwise and favor the droplet model. None of these 
studies has conclusively resolved which type of broken 
ergodicity takes place in the low temperature phase in fi- 



nite dimension, motivating a search for new approaches. 

We suggest that the nature of the low temperature 
phase can be determined by studying the spectrum of 
the spin-spin correlation function (SiSj) = CV,-. In the 
case of a single PSP we will argue that this correlation 
function has at most a single extensive eigenvalue. Thus, 
we take the existence of more than one extensive eigen- 
value to be clear evidence for multiple PSPs, ie RSB. 
Our main results are shown in Fig. |l|, where we illustrate 
this behavior using Exchange Monte Carlo JhJ simula- 
tions for the SK model, both above (where there is a 
single pure state) and below the Almeida-Thouless (AT) 
line jllj . We have also used Monte-Carlo simulations to 
study Ising spin glasses in four dimensions. Here we see 
no signs of RSB out to the largest size studied (N = 6 4 
spins) and instead find finite size behavior for the second 
largest eigenvalue which is consistent with droplet model 
expectations. 

At a continuous symmetry-breaking phase transition, a 
suitably defined correlation function develops long-range 
order. In systems without quenched disorder, the eigen- 
values C(k) of the appropriate correlation function can 
typically be labelled by wavevector k, and the long-range 
order is signalled by C(k) becoming extensive below the 
transition temperature at a single value of k. In sys- 
tems with quenched disorder, the correlation function 
eigenf unctions are not plane waves, but long-range or- 
der is still signalled by an extensive eigenvalue. For Ising 
spin glasses, the correlation function matrix Cij is a real 
symmetric positive semi-definite matrix with trace equal 
to the number of sites N, and is analogous to the one- 
particle density matrix of a superfluid. In either system 
the order is off-diagonal in a position basis, and the fact 
that it is long-ranged is reflected in its spectrum: an ex- 
tensive eigenvalue always signals long range order since 
the associated eigenfunction must be extended 

We now argue that there will be only one extensive 
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eigenvalue in the case of broken ergodicity with a single 
PSP. We rewrite 



C ij = (S i )(S j )+V ij 



(1) 



where Vij = (SiSj) — (Si)(Sj) = (SiSj) c is the connected 
correlation function. If we ignore V, the matrix is 
a pure projector C° = \v)(v\ onto the state \v) with 
Vi = (Si)- C° has one large eigenvalue (v\v) = TrC° = 
^^S,) 2 , and the remaining eigenvalues are zero. The 
influence of V on the spectrum of C\j depends on the 
typical value of its matrix elements. If we assume that 
Vij ~ N~ s with S > 0, it follows from first order per- 
turbation theory that the largest eigenvalue will still be 
extensive, and that the largest subdominant eigenvalue 
A 2 ~ iV 1 " 5 at most. 

In some cases we can put a bound on S. For instance, if 
we simply assume that the spin-glass susceptibility \sg 
is of 0(1), then we get 8 > 1/2. This should be the case 
above the AT line in the SK model. The calculations 
shown in Fig. 0(b) conform to this picture, with S chang- 
ing smoothly from ~ 1/2 in the figure to ~ 1 for larger h 
(where the correlations approach those of a ferromagnet, 
and hence <$ — > 1). 

While the above arguments make no direct reference 
to spatial dimension, they do rely on the notion of a 'typ- 
ical' element of V. This idea is certainly appropriate for 
infinite-range models such as the SK problem. We are 
of course most interested in finite-dimensional problems 
with a spin glass phase above zero temperature. Here 
the outstanding alternative to the many-valley picture is 
the droplet picture ||. In this picture there are 'typical' 
elements of V which are exponentially small, plus a set of 
elements of 0(1) in magnitude. The fraction of the latter 
is of 0(l/L e ) where L is the system size and 9 is a scaling 
exponent from the zero-temperature fixed point. Again 
we consider the 'worst' case: supposing that V for a finite 
sample is dominated by one large active droplet of size of 
0{L), then the big elements of V, appearing with proba- 
bility - 1/L e = l/N e / d , are coherent, and so will give a 
large eigenvalue of order N x N~ e / d = N x ~ e / d . (We have 
verified this with simple numerical experiments.) If V is 
incoherent then its eigenvalues should grow more slowly 
(or decay) with N. Hence, given the principal scaling 
assumption of the droplet picture, we expect the second 
eigenvalue A2 of Cy to grow as N 1 ^ 6 ^ or slower. 

It follows from the above arguments that as long as 
there is one PSP (or one pure state), there can be no 
more than one eigenvalue of C which is of order N. Thus 
the observation of more than one such eigenvalue directly 
implies multiple PSPs. 

The SK model is a perfect candidate to test our ideas 
regarding multiple large eigenvalues of Cij , since we can 
tune the nature of the broken ergodicity by simply vary- 
ing the external magnetic field h. We have performed 
numerical calculations using Exchange Monte Carlo pOl , 



which allows for faster jumps across large energy bar- 
riers. Our criteria for equilibration follow closely those 
used in Ref. . We check for agreement between two dif- 
ferent ways of calculating xsg', one method |13| uses the 
averaging of the overlap of two uncoupled replicas, and 
the other uses the standard thermal averaging in Monte 
Carlo simulations. We also check the symmetry of P(q) 
and the variance of the eigenvalues of Cij . 

We find that the probability distributions of the eigen- 
values of C are broad (at least for the first two eigenval- 
ues) below the AT line, and very sharp above it. We il- 
lustrate this in Fig. ||. The breadth of these distributions 
indicates the need to do disorder averaging over a large 
ensemble (300-2000), at least in the spin glass phase. In 
Fig. we show the scaling of the disorder average of the 
ten largest eigenvalues as a function of system size, both 
below [Fig. 0(a)] and above [Fig. 0(b)] the AT line in 
the SK model. It is clear from Fig. 0(a) that at least 
two eigenvalues are of O(N) for N > 100. We expect 
|fl5f further O(N) eigenvalues to emerge for larger N, as 
suggested by the behavior of [Aa]^ in the figure. In con- 
trast, there is only one large eigenvalue in Fig. 0(b). We 
find further that, above the AT line, [X 2 ] av /N ~ N~ - 52 , 
consistent with our previous arguments. MC results for 
larger h show that [\2\avlN decays with a larger expo- 
nent (we have observed up to ~ 0.75), which we expect 
to approach 1 for large enough h. 

Fig. 0(a) suggests that the spectrum of Cy for the SK 
problem is dominated by two large eigenvalues (for the 
sizes considered here). We can reproduce this behaviour 
with the following simple model. Suppose that phase 
space consists of only two spin configurations 1 and 2, and 
ignore all others. Take C(a) = aC^ + (1 - a)C^ 2 \ with 
and O' 2 ' corresponding to the Cij of the two differ- 



ent configurations S± and S^' at zero T, and a (a ther- 
modynamic weight) ranging from to 1/2. The overlap 

between the two states is given by qi2 — J2i S^S^/N. 
It can be easily shown that this matrix has only two 
nonzero eigenvalues, corresponding to 



,(2) 



A±(«i2,a) _ l± v / '7?2 + (l-9?2)(2a-l) 



N 



(2) 



Note that X±/N range from 1 and at a = to 
(1 ± Ife |)/2 at a = 1/2. It is clear from (§) that the 
two largest eigenvalues can vary over a wide range, while 
still in general remaining of O(N) [^6|. Hence (as we 
saw numerically) it is important to study the probabil- 
ity distribution for each eigenvalue P(A^), rather than 
the distribution of the eigenvalues for a single disorder 
realization. At this low level of approximation we al- 
ready see that the probability distributions of the first 
two eigenvalues will be very broad in the frozen phase 
whenever the probability distribution of qi2, Pi2(q), is 
broad. This simple picture however lacks any finite tem- 
perature and correlation effects. To introduce tempera- 



2 



ture in the model we let S^' and S^' become gaussian 
random variables. We decompose P(q) from our MC data 
as (l/2)(Pii(q) + Pi2{q)), with Pu(q) (the self-overlap) 
a Gaussian which determines the mean and variance of 
S 1 - 1 ^ and . We then adjust their relative distribution 
to match Pi2(q). This gives us a joint distribution for 
and which we use to generate a distribution 
of matrices C(a — 1/2). The eigenvalues may then be 
obtained either by an analytical perturbation approach 
or by direct numerical diagonalization of the matrix C . 
Fig. ^ compares the resulting eigenvalue distributions for 
N = 64, with those obtained directly from the MC re- 
sults for the SK model. It is striking how closely they 
resemble one another in qualitative and quantitative be- 
havior, given the simplicity of our two-state model. 

Thus we find a clear confirmation of our ideas in the be- 
havior of the SK model, for which we know the nature of 
the ergodicity breaking in the various equilibrium phases. 
We now use these ideas to study the four-dimensional 
Ising spin glass or Edward- Anderson (EA) model, with 
nearest-neighbor interactions and a Gaussian distribu- 
tion of the J{j 's with variance J. In Figure |l|(c) we show 
the scaling of [Xi] av /N for the first ten eigenvalues of C 
at T/J = 1.0 and h/J = 0. These runs are rather deep 
into the frozen phase, since (lTj T c » 1.75J. We choose 
this low temperature in order to work as far as possible 
from the critical region. This low temperature, plus the 
time involved in measuring dj , has limited us thus far to 
L < 6. (We note that, even at this low temperature, we 
are still not fully out of the critical region, according to 
Rcf. fis}| .) In this region of size and temperature we find, 
as in the SK spin glass phase, a broad and asymmetric 
distribution of Ai and A2, similar to that for the frozen 
phase illustrated in Fig. 2. 

We have studied both [Xi] av and {\i)ty P for these dis- 
tributions (the latter defined as exp([ln A,*] aw )). Fig. 1(c) 
shows [\2\av/N decaying with N. On a double-log scale 
we see a clear straight line with exponent ~ 0.11. The be- 
havior for (\2)typ is similar, except the exponent is larger, 
~ 0.15. This latter exponent is consistent with our lower 
bound for 5, given that estimates of 9 in 4D range [ p~0|Jl9| 
from 0.6 to 0.8. Hence these data appear to fit the droplet 
scenario, with a single PSP in the frozen phase. We can- 
not of course rule out the possibility that the [\2\av/N 
points (and others for i > 2) may flatten out at larger N, 
as occurred for the SK case at about N — 100. Only fur- 
ther work at larger N can help with this question. Also, 
while it is consistent that {\2)ty P /N decays as expected 
according to our arguments and the droplet picture, the 
slower decay of [\2\av/N — which clearly results from the 
skew in the distribution — needs some understanding. 

In summary, we have proposed, and numerically 
tested, a method for identifying the nature of erg odic- 

that 



? (2) 



has multiple large eigenvalues. Our MC results for the 
infinite-range SK problem show a clear qualitative dif- 
ference in the long-range order above and below the AT 
line. Because of the generality of these ideas, we expect 
that they may be applied to other problems in statistical 
physics for which RSB is a possibility. We have also pre- 
sented results for the EA model in four space dimensions. 
Because of the finite-size effects plaguing all spin-glass 
simulations, these results cannot be viewed as conclusive. 
However our results over the entire range for which we 
can reliably compute both thermal and disorder averages 
tend to support the droplet picture, with one pure-state 
pair: we see no sign of multiple large eigenvalues, and 
(M)typ/N decays roughly in line with droplet model ex- 
pectations. Future work based on this approach should 
shed significant further light on the nature of ergodicity 
breaking in finite-dimensional spin glasses. 
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RSB occurs if and only if the spin correlation function 
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FIG. 1. Scaling of the average of the ten largest eigenvalues 
of dj as a function of system size N in (a) the SK model below 
the AT line (ft = 0, T/J = 0.4), (b) the SK model above the 
AT line (ft/ J = 1.2, T/J = 0.4), and (c) the EA model in 4D 
(ft/ J = 0, T/J = 1.0). 
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FIG. 2. Distribution of the first (thick lines) and second 
(thin lines) eigenvalue of dj in the SK model at ft/ J = 
(solid line) and ft/ J = 1.2 (dashed line), above the AT line. 
Here T/J = 0.4 and N=128. 
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FIG. 3. Distribution of the first (solid line) and second 
(dashed line) eigenvalue of dj obtained from the MC sim- 
ulation of the SK model at N = 64 and T/J = 0.4 (thin line), 
and the respective distributions obtained from the two pure 
state model simulation (thick line) with a = 1/2. 
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